Comparing Visualizations
Intro
This post is inspired by a discussion in LinkedIn about the good and the ugly about boxplots vs. the scatter plots posted by Paul van der Laken, PhD in which he cites an article by Nick Desbarats titled “I’ve stopped using boxplots. Should you?”, a very thought provoking piece that you can read here.
Even though I agree with the general idea that simpler is better, and you have to always think first in your audience and whether they would understand or not a plot, in my opinion there is no a best type of plot over other. A plot should be used with a purpose.
Another point against boxplots is that they are complex to understand, and you need people with statistical comprehension to read them. Which is true. Considering I work mainly with HR professionals and statistics is not our main strength, boxplots condense a lot of statistical information. So, why bother?
An explanation of all the information a boxplot provides (outliers, quartiles 1 and 3, median)
In my opinion, even if you are making a pie chart or a bar chart, you always have to explain what the visualization is saying, specially if you are using some other type of chart people is no familiar with. Don’t assume your audience will interpret the plot the same way you intended to.
Don’t assume the user will know how to read the plot
Even though boxplots are hard to understand, specially for HR professionales, I believe they can be useful for people that work in Compensation and Benefits for instance.
And I believe every plot serves a purpose. For instance, in commercial presentations, I’d always include a sankey chart for the Wow Effect but I’ve barely used it in production because my clients wouldn’t know how to read them. So, my point is that you always have to use a visualization the user and the audience will understand.
So, given all that, let’s load some data and compare some plots! 🤓
The data
The data we are going to see, is a open salary survey developed by a Latin American RUG called R4HR Club de R para RRHH, a community for learning how to use R for Spanish-speaking people that work or want to work in Human Resource. You can find the raw data and our analysis in this link.
So first, let’s load some libraries and a subset of the data. If you don’t want to see all the data preparation process, simply go to Comparing visualizations in the left menu.
Data preparation
# Libraries & Data ----
library(tidyverse) # For data wrangling and cleansing
library(funModeling) # For EDA and some data cleansing... and much more
library(gt) # For displaying tables
library(scales) # For adjusments on the axis display of the plots
library(googlesheets4) # Reading files from Google Sheets
library(gargle) # Handling special characters from Spanish
# Data
salaries <- read_sheet("1aeuu9dVfN42EjyvbmhEcsf0ilSz2DiXU-0MpnF896ss") %>%
select(gender = "Género",
role = "¿En qué puesto trabajás?",
gross_salary = "¿Cuál es tu remuneración BRUTA MENSUAL en tu moneda local? (antes de impuestos y deducciones)",
country = "País en el que trabajas",
work_type = "Trabajo",
work_hours = "Tipo de contratación") %>%
filter(country == "Argentina",
work_type == "Relación de Dependencia",
gender %in% c("Femenino", "Masculino")) %>%
select(-country, -work_type)
## Clean data (you can't hide from it) ----
salaries <- salaries %>%
mutate(gross_salary = as.numeric(unlist(gross_salary)))
# Add a column to estimate full time salary for part time workers
salaries <- salaries %>%
mutate(multiplier = if_else(work_hours == "Part time", 1.5, 1),
ft_salary = gross_salary * multiplier) %>%
select(-work_hours, -multiplier, -gross_salary)
# Filter and unify roles
salaries <- salaries %>%
filter(role != "Juzgado Civil y Comercial",
role != "Programador",
role != "Cuidado",
role != "Asesor",
role != "Jefe de Proyecto") %>%
mutate(role = str_trim(role, side = "both"), # Elimina espacios vacíos
role = fct_collapse(role, "Gerente" = "Superintendente"),
role = fct_collapse(role, "Director" = "Director ( escalafón municipal)"),
role = fct_collapse(role, "HRBP" = c("Senior Consultoría", "specialist", "especialista",
"Especialista en selección IT", "Recruiter")),
role = fct_collapse(role, "Responsable" = c("Coordinación", "Coordinador de Payroll",
"Encargado", "Supervisor")),
role = fct_collapse(role, "Administrativo" = c("Asistente", "Asistente RRHH", "Aux",
"Capacitador", "Consultor Ejecutivo",
"consultor jr")),
role = fct_collapse(role, "Analista" = c("Asesoramiento", "Consultor", "Generalista",
"Reclutadora", "Selectora", "Senior")))
# Filter roles to analyze
salaries <- salaries %>%
filter(role %in% c("Analista", "HRBP", "Responsable",
"Jefe", "Gerente"))
# Write a csv file to share
write_delim(salaries, file = "hr_salaries_arg.csv",
delim = ";")I typically like to customize my charts, so I usually do this modifications.
options(scipen = 999) # Modifies the scientific notations of plots to nominal values
extrafont::loadfonts(quiet = TRUE) # Loads different fonts into R
# Clean style with grey horizontal lines
styleh <- theme(panel.grid = element_blank(),
plot.background = element_rect(fill = "#FBFCFC"),
panel.background = element_blank(),
panel.grid.major.y = element_line(color = "#AEB6BF"),
text = element_text(family = "Roboto"),
plot.title.position = "plot")
stylev <- theme(panel.grid = element_blank(),
plot.background = element_rect(fill = "#FBFCFC"),
panel.background = element_blank(),
panel.grid.major.x = element_line(color = "#AEB6BF"),
text = element_text(family = "Roboto"),
plot.title.position = "plot")
# Modify the way the y axis is displayed
axis_x_n <- scale_x_continuous(labels = comma_format(big.mark = ".", decimal.mark = ","))
axis_y_n <- scale_y_continuous(labels = comma_format(big.mark = ".", decimal.mark = ","))
# Colors
gender_colors <- genero <- c("#8624F5", "#1FC3AA") # Purple and green (sort of :p)
# Data source for plot's caption
fuente <- "Data Source: Encuesta KIWI de Sueldos de RRHH LATAM 2020\nR4HR Club de R para RRHH"The data was collected in Spanish, so let’s translate the values into English first and summarise the information:
# Translate values
salaries <- salaries %>%
mutate(gender = fct_recode(gender, "Female" = "Femenino",
"Male" = "Masculino"),
role = fct_recode(role, "Analyst" = "Analista",
"Supervisor" = "Responsable",
"Head" = "Jefe",
"Manager" = "Gerente"),
role = fct_relevel(role, c("Analyst", "HRBP", "Supervisor",
"Head", "Manager")))
# Let's make a summary analysis of the data
summary(salaries)## gender role ft_salary
## Female:360 Analyst :223 Min. : 2
## Male :176 Supervisor :136 1st Qu.: 56000
## Head : 72 Median : 75000
## HRBP : 57 Mean : 93288
## Manager : 48 3rd Qu.: 105250
## Administrativo: 0 Max. :2140000
## (Other) : 0There are a couple of unusual values. First the minimum value, that’s clearly a mistake (or a bad intended person), and the maximum value, that could possible, but highly unusual for the Argentinean market. If we make a histogram, the result would be awkward.
ggplot(salaries, aes(x = ft_salary)) +
geom_histogram() +
labs(title = "Gross Salary Distribution in HR",
subtitle = "Data from Argentina | In AR$",
x = NULL, y = NULL,
caption = fuente) +
axis_x_n +
styleh
This is where funModeling comes handy. The profiling_num function delivers a table with a lot of descriptive statistics for numerical variables.
(numerical <- profiling_num(salaries))## variable mean std_dev variation_coef p_01 p_05 p_25 p_50 p_75
## 1 ft_salary 93287.88 104693.9 1.122267 217.5 35000 56000 75000 105250
## p_95 p_99 skewness kurtosis iqr range_98 range_80
## 1 195500 290000 14.41845 275.362 49250 [217.5, 290000] [44500, 150000]Since I want to analyze central values of the salaries, I’ll filter everything beyond the percentiles 5 and 95.
# Store percentiles 5 and 95 to filter
p05 <- numerical[1,6]
p95 <- numerical[1,10]
# Filter values within the p05 a p95 values
salaries <- salaries %>%
filter(between( # Supporting function
ft_salary, # Variable to filter
p05, # Minimum threshold
p95 # Maximun threshold
))
# Now I can remove the objects I would no longer use
rm(numerical, p05, p95)Now that we have a cleaner version of the data we can start comparing the visualizations:
ggplot(salaries, aes(x = ft_salary)) +
geom_histogram() +
labs(title = "Gross Salary Distribution in HR | Clean Data",
subtitle = "Data from Argentina | In AR$",
x = NULL, y = NULL,
caption = fuente) +
axis_x_n +
styleh
Comparing visualizations
Credits: Allison Horst @allison_horst
Why would I use a boxplot instead of a simple bar plot? Let’s give a try using a bar chart to compare the median salary for both men and women in each role:
salaries %>%
group_by(role, gender) %>%
summarise(median_salary = median(ft_salary)) %>%
ggplot(aes(x = role, y = median_salary, fill = gender)) +
geom_col(position = "dodge") +
scale_fill_manual(values = gender_colors) +
axis_y_n +
styleh +
labs(title = "Median Salary per Role and Gender in HR",
subtitle = "Data from Argentina | In AR$",
y = "Median Salary in AR$",
x = NULL,
fill = "Gender",
caption = fuente)
So if we look at each bar we can see that the pay gap for Analyst and Supervisor is larger than in the other roles, so male HR people earns more than their female colleagues. But when we look into HRBPs and Managers, the median salary for women is slightly higher than men, and even in the Head role, the gap is quite close. So with this evidence we could say that the gender salary gap in Human Resources in Argentina it’s not a issue, but…
Boxplots
In the discussion in LinkedIn, Nick Desbarats said that he struggles to come up with use cases in which boxplots would be the best choice, so I shared this plot:
ggplot(salaries, aes(x = role, y = ft_salary, fill = gender)) +
geom_boxplot() +
scale_fill_manual(values = gender_colors) +
axis_y_n +
styleh +
labs(title = "Salary Distribution in HR Roles in Argentina",
subtitle = "In AR$",
y = "Gross Salary in AR$",
x = NULL,
fill = "Gender",
caption = fuente)
What I like about this visualization is that we can see the distribution of the salaries by the size of the halves of the boxes. Les take for instance the Head position. The medians are similar, but in the case of women the bottom half of the box is larger, so that means that the range of salaries for women is broader. That tells us that there are women in Head position with salaries far below the median.
The opposite happens with male professionals in the Head position. The top half of the box is larger meaning that there are men in the Head position with salaries far above the median.
But Nick has a point. How many data points we have? 3, 15, 300? We can’t tell from this plot. So he suggested to try a violin chart. So let’s see what goes on:
Violin chart
ggplot(salaries, aes(x = role, y = ft_salary, fill = gender)) +
geom_violin() +
scale_fill_manual(values = gender_colors) +
axis_y_n +
styleh +
labs(title = "Salary Distribution in HR Roles in Argentina",
subtitle = "In AR$",
y = "Gross Salary in AR$",
x = NULL,
fill = "Gender",
caption = fuente)
Given the amount of roles we can’t appreciate the value of this kind of chart. So let’s repeat it only with Analysts and Managers.
salaries %>%
filter(role %in% c("Analyst", "Manager")) %>%
ggplot(aes(x = role, y = ft_salary, fill = gender)) +
geom_violin() +
scale_fill_manual(values = gender_colors) +
axis_y_n +
styleh +
labs(title = "Salary Distribution in HR Roles in Argentina",
subtitle = "In AR$",
y = "Gross Salary in AR$",
x = NULL,
fill = "Gender",
caption = fuente)
The width of each plot indicates that the region is populated with more cases. So, for male managers we can see that most of them are close to the median. The lenght of the plots indicates the range of the values. So, in the case of female managers the range goes from around AR$ 50.000 up to close to AR$ 200.000 and the width is quite even all along the data points.
In the case of the Analysts, for women we can see that there are wider section around AR$ 50.000 and the start to narrow to the top. In the case of men the widest part is above than women, and the range expands to greater values.
Perhaps for this dataset, the violin chart is not the most suitable case. Let’s try a scatter plot.
Scatter plot
Another way we can see the distribution of the data points is the scatter plot. We tend to see them for relationships between two numerical variables, but we can use it with nominal variables as well.
ggplot(salaries, aes(x = role, y = ft_salary, color = gender)) +
geom_point(size = 3,
alpha = 0.2,
position = position_jitter(0.3)) +
scale_color_manual(values = gender_colors) +
styleh +
axis_y_n +
labs(title = "Salary Distribution per Gender and Role in HR",
subtitle = "HR Professionals in Argentina | In AR$",
y = "Gross Salary in AR$",
x = NULL,
color = "Gender",
caption = fuente)
Again, for this dataset, the scatter plot can be more confusing because in some positions, like Analysts and Supervisor are so populated and it’s hard to tell the differences by color. But for instance, for Managers we can appreciate the range of the salaries, and also the concentration for men.
Perhaps we could split the charts in smaller charts, to see if it helps to clarify the data and its interpretation.
ggplot(salaries, aes(x = gender, y = ft_salary, color = gender)) +
geom_point(size = 3,
alpha = 0.2,
position = position_jitter(0.22)) +
scale_color_manual(values = gender_colors) +
styleh +
axis_y_n +
labs(title = "Salary Distribution per Gender and Role in HR",
subtitle = "HR Professionals in Argentina | In AR$",
y = "Gross Salary in AR$",
x = NULL,
color = "Gender",
caption = fuente) +
facet_wrap(~role, nrow = 1)
Now we can appreciate in a better way all the positions of the data points, where data is more concentrated and also the different ranges of the salaries for both men and women in the different roles. It’s easier to compare the
Conclusions
I’ve started this exercise biased by own experience using different kinds of charts.
LS0tDQp0aXRsZTogIkNvbXBhcmluZyBWaXN1YWxpemF0aW9ucyINCmF1dGhvcjogIlNlcmdpbyBHYXJjaWEgTW9yYSINCmRhdGU6ICIyMi8yLzIwMjIiDQpvdXRwdXQ6IA0KICBybWRmb3JtYXRzOjpyb2JvYm9vazoNCiAgICBjb2RlX2Rvd25sb2FkOiB0cnVlDQogICAgY29kZV9mb2xkaW5nOiBoaWRlDQotLS0NCg0KYGBge3Igc2V0dXAsIGluY2x1ZGU9RkFMU0V9DQprbml0cjo6b3B0c19jaHVuayRzZXQoZWNobyA9IFRSVUUsIG1lc3NhZ2UgPSBGQUxTRSwgd2FybmluZyA9IEZBTFNFLCBmaWcucmV0aW5hID0gMykNCmBgYA0KDQojIEludHJvDQoNClRoaXMgcG9zdCBpcyBpbnNwaXJlZCBieSBhIFtkaXNjdXNzaW9uIGluIExpbmtlZEluXShodHRwczovL3d3dy5saW5rZWRpbi5jb20vcG9zdHMvcGF1bHZhbmRlcmxha2VuX3RoaW5rLXR3aWNlLWJlZm9yZS1wbG90dGluZy15b3VyLWJveGVzLWFjdGl2aXR5LTY4OTkzNjkyNDMzOTgxOTMxNTItNjNZMCkgYWJvdXQgdGhlIGdvb2QgYW5kIHRoZSB1Z2x5IGFib3V0IGJveHBsb3RzIHZzLiB0aGUgc2NhdHRlciBwbG90cyBwb3N0ZWQgYnkgW1BhdWwgdmFuIGRlciBMYWtlbiwgUGhEXShodHRwczovL3d3dy5saW5rZWRpbi5jb20vaW4vcGF1bHZhbmRlcmxha2VuLykgaW4gd2hpY2ggaGUgY2l0ZXMgYW4gYXJ0aWNsZSBieSBbTmljayBEZXNiYXJhdHNdKGh0dHBzOi8vd3d3LmxpbmtlZGluLmNvbS9pbi9uaWNrZGVzYmFyYXRzLykgdGl0bGVkICoqIkkndmUgc3RvcHBlZCB1c2luZyBib3hwbG90cy4gU2hvdWxkIHlvdT8iKiosIGEgdmVyeSB0aG91Z2h0IHByb3Zva2luZyBwaWVjZSB0aGF0IFt5b3UgY2FuIHJlYWQgaGVyZV0oaHR0cHM6Ly9uaWdodGluZ2FsZWR2cy5jb20vaXZlLXN0b3BwZWQtdXNpbmctYm94LXBsb3RzLXNob3VsZC15b3UvKS4NCg0KRXZlbiB0aG91Z2ggSSBhZ3JlZSB3aXRoIHRoZSBnZW5lcmFsIGlkZWEgdGhhdCBzaW1wbGVyIGlzIGJldHRlciwgYW5kIHlvdSBoYXZlIHRvIGFsd2F5cyB0aGluayBmaXJzdCBpbiB5b3VyIGF1ZGllbmNlIGFuZCB3aGV0aGVyIHRoZXkgd291bGQgdW5kZXJzdGFuZCBvciBub3QgYSBwbG90LCBpbiBteSBvcGluaW9uIHRoZXJlIGlzIG5vIGEgKmJlc3QgdHlwZSBvZiBwbG90KiBvdmVyIG90aGVyLiBBIHBsb3Qgc2hvdWxkIGJlIHVzZWQgd2l0aCBhIHB1cnBvc2UuDQoNCkFub3RoZXIgcG9pbnQgYWdhaW5zdCBib3hwbG90cyBpcyB0aGF0IHRoZXkgYXJlIGNvbXBsZXggdG8gdW5kZXJzdGFuZCwgYW5kIHlvdSBuZWVkIHBlb3BsZSB3aXRoIHN0YXRpc3RpY2FsIGNvbXByZWhlbnNpb24gdG8gcmVhZCB0aGVtLiBXaGljaCBpcyB0cnVlLiBDb25zaWRlcmluZyBJIHdvcmsgbWFpbmx5IHdpdGggSFIgcHJvZmVzc2lvbmFscyBhbmQgc3RhdGlzdGljcyBpcyBub3Qgb3VyIG1haW4gc3RyZW5ndGgsIGJveHBsb3RzIGNvbmRlbnNlIGEgbG90IG9mIHN0YXRpc3RpY2FsIGluZm9ybWF0aW9uLiBTbywgd2h5IGJvdGhlcj8NCg0KIVtBbiBleHBsYW5hdGlvbiBvZiBhbGwgdGhlIGluZm9ybWF0aW9uIGEgYm94cGxvdCBwcm92aWRlcyAob3V0bGllcnMsIHF1YXJ0aWxlcyAxIGFuZCAzLCBtZWRpYW4pXShodHRwczovL21pcm8ubWVkaXVtLmNvbS9tYXgvMTgzOC8xKjJjMjFTa3pKTWYzZnJQWFBBUl9nWkEucG5nICJTdGF0aXN0aWNhbCBJbmZvcm1hdGlvbiBvZiBhIEJveHBsb3QiKXt3aWR0aD0iNDU2In0NCg0KSW4gbXkgb3BpbmlvbiwgZXZlbiBpZiB5b3UgYXJlIG1ha2luZyBhIHBpZSBjaGFydCBvciBhIGJhciBjaGFydCwgeW91IGFsd2F5cyBoYXZlIHRvIGV4cGxhaW4gd2hhdCB0aGUgdmlzdWFsaXphdGlvbiBpcyBzYXlpbmcsIHNwZWNpYWxseSBpZiB5b3UgYXJlIHVzaW5nIHNvbWUgb3RoZXIgdHlwZSBvZiBjaGFydCBwZW9wbGUgaXMgbm8gZmFtaWxpYXIgd2l0aC4gRG9uJ3QgYXNzdW1lIHlvdXIgYXVkaWVuY2Ugd2lsbCBpbnRlcnByZXQgdGhlIHBsb3QgdGhlIHNhbWUgd2F5IHlvdSBpbnRlbmRlZCB0by4NCg0KIVtEb24ndCBhc3N1bWUgdGhlIHVzZXIgd2lsbCBrbm93IGhvdyB0byByZWFkIHRoZSBwbG90XShodHRwczovL2dpdGh1Yi5jb20vY2hlY2hvaWQvY29tcGFyaW5nLXZpc3VhbGl6YXRpb25zL2Jsb2IvbWFpbi9pbWFnZXMvYnVsbC10ZXJyaWVyLnBuZz9yYXc9dHJ1ZSl7d2lkdGg9IjM0OSJ9DQoNCkV2ZW4gdGhvdWdoIGJveHBsb3RzIGFyZSBoYXJkIHRvIHVuZGVyc3RhbmQsIHNwZWNpYWxseSBmb3IgSFIgcHJvZmVzc2lvbmFsZXMsIEkgYmVsaWV2ZSB0aGV5IGNhbiBiZSB1c2VmdWwgZm9yIHBlb3BsZSB0aGF0IHdvcmsgaW4gQ29tcGVuc2F0aW9uIGFuZCBCZW5lZml0cyBmb3IgaW5zdGFuY2UuDQoNCkFuZCBJIGJlbGlldmUgZXZlcnkgcGxvdCBzZXJ2ZXMgYSBwdXJwb3NlLiBGb3IgaW5zdGFuY2UsIGluIGNvbW1lcmNpYWwgcHJlc2VudGF0aW9ucywgSSdkIGFsd2F5cyBpbmNsdWRlIGEgc2Fua2V5IGNoYXJ0IGZvciB0aGUgKldvdyBFZmZlY3QqIGJ1dCBJJ3ZlIGJhcmVseSB1c2VkIGl0IGluIHByb2R1Y3Rpb24gYmVjYXVzZSBteSBjbGllbnRzIHdvdWxkbid0IGtub3cgaG93IHRvIHJlYWQgdGhlbS4gU28sIG15IHBvaW50IGlzIHRoYXQgeW91IGFsd2F5cyBoYXZlIHRvIHVzZSBhIHZpc3VhbGl6YXRpb24gdGhlIHVzZXIgYW5kIHRoZSBhdWRpZW5jZSB3aWxsIHVuZGVyc3RhbmQuDQoNClNvLCBnaXZlbiBhbGwgdGhhdCwgbGV0J3MgbG9hZCBzb21lIGRhdGEgYW5kIGNvbXBhcmUgc29tZSBwbG90cyEg8J+kkw0KDQojIFRoZSBkYXRhDQoNClRoZSBkYXRhIHdlIGFyZSBnb2luZyB0byBzZWUsIGlzIGEgb3BlbiBzYWxhcnkgc3VydmV5IGRldmVsb3BlZCBieSBhIExhdGluIEFtZXJpY2FuIFJVRyBjYWxsZWQgW1I0SFIgQ2x1YiBkZSBSIHBhcmEgUlJISF0oaHR0cHM6Ly9yNGhyLmNsdWIvKSwgYSBjb21tdW5pdHkgZm9yIGxlYXJuaW5nIGhvdyB0byB1c2UgUiBmb3IgU3BhbmlzaC1zcGVha2luZyBwZW9wbGUgdGhhdCB3b3JrIG9yIHdhbnQgdG8gd29yayBpbiBIdW1hbiBSZXNvdXJjZS4gWW91IGNhbiBmaW5kIHRoZSByYXcgZGF0YSBhbmQgb3VyIGFuYWx5c2lzIGluIFt0aGlzIGxpbmtdKGh0dHBzOi8vcnB1YnMuY29tL0RhdGE0SFIvZW5jdWVzdGEta2l3aS0yMDIwKS4NCg0KU28gZmlyc3QsIGxldCdzIGxvYWQgc29tZSBsaWJyYXJpZXMgYW5kIGEgc3Vic2V0IG9mIHRoZSBkYXRhLiBJZiB5b3UgZG9uJ3Qgd2FudCB0byBzZWUgYWxsIHRoZSBkYXRhIHByZXBhcmF0aW9uIHByb2Nlc3MsIHNpbXBseSBnbyB0byAqKkNvbXBhcmluZyB2aXN1YWxpemF0aW9ucyoqIGluIHRoZSBsZWZ0IG1lbnUuDQoNCiMjIERhdGEgcHJlcGFyYXRpb24NCg0KYGBge3IgZGF0YV9saWJyYXJpZXN9DQojIExpYnJhcmllcyAmIERhdGEgLS0tLQ0KbGlicmFyeSh0aWR5dmVyc2UpICAgICMgRm9yIGRhdGEgd3JhbmdsaW5nIGFuZCBjbGVhbnNpbmcNCmxpYnJhcnkoZnVuTW9kZWxpbmcpICAjIEZvciBFREEgYW5kIHNvbWUgZGF0YSBjbGVhbnNpbmcuLi4gYW5kIG11Y2ggbW9yZQ0KbGlicmFyeShndCkgICAgICAgICAgICMgRm9yIGRpc3BsYXlpbmcgdGFibGVzDQpsaWJyYXJ5KHNjYWxlcykgICAgICAgIyBGb3IgYWRqdXNtZW50cyBvbiB0aGUgYXhpcyBkaXNwbGF5IG9mIHRoZSBwbG90cw0KbGlicmFyeShnb29nbGVzaGVldHM0KSAjIFJlYWRpbmcgZmlsZXMgZnJvbSBHb29nbGUgU2hlZXRzDQpsaWJyYXJ5KGdhcmdsZSkgICAgICAgIyBIYW5kbGluZyBzcGVjaWFsIGNoYXJhY3RlcnMgZnJvbSBTcGFuaXNoDQoNCiMgRGF0YQ0Kc2FsYXJpZXMgPC0gcmVhZF9zaGVldCgiMWFldXU5ZFZmTjQyRWp5dmJtaEVjc2YwaWxTejJEaVhVLTBNcG5GODk2c3MiKSAlPiUgDQogICAgc2VsZWN0KGdlbmRlciA9ICJHw6luZXJvIiwNCiAgICAgICAgICAgcm9sZSA9ICLCv0VuIHF1w6kgcHVlc3RvIHRyYWJhasOhcz8iLA0KICAgICAgICAgICBncm9zc19zYWxhcnkgPSAiwr9DdcOhbCBlcyB0dSByZW11bmVyYWNpw7NuIEJSVVRBIE1FTlNVQUwgZW4gdHUgbW9uZWRhIGxvY2FsPyAoYW50ZXMgZGUgaW1wdWVzdG9zIHkgZGVkdWNjaW9uZXMpIiwNCiAgICAgICAgICAgY291bnRyeSA9ICJQYcOtcyBlbiBlbCBxdWUgdHJhYmFqYXMiLA0KICAgICAgICAgICB3b3JrX3R5cGUgPSAiVHJhYmFqbyIsDQogICAgICAgICAgIHdvcmtfaG91cnMgPSAiVGlwbyBkZSBjb250cmF0YWNpw7NuIikgJT4lIA0KICBmaWx0ZXIoY291bnRyeSA9PSAiQXJnZW50aW5hIiwNCiAgICAgICAgIHdvcmtfdHlwZSA9PSAiUmVsYWNpw7NuIGRlIERlcGVuZGVuY2lhIiwNCiAgICAgICAgIGdlbmRlciAlaW4lIGMoIkZlbWVuaW5vIiwgIk1hc2N1bGlubyIpKSAlPiUgDQogIHNlbGVjdCgtY291bnRyeSwgLXdvcmtfdHlwZSkNCg0KIyMgQ2xlYW4gZGF0YSAoeW91IGNhbid0IGhpZGUgZnJvbSBpdCkgLS0tLQ0Kc2FsYXJpZXMgPC0gc2FsYXJpZXMgJT4lIA0KICBtdXRhdGUoZ3Jvc3Nfc2FsYXJ5ID0gYXMubnVtZXJpYyh1bmxpc3QoZ3Jvc3Nfc2FsYXJ5KSkpDQoNCiMgQWRkIGEgY29sdW1uIHRvIGVzdGltYXRlIGZ1bGwgdGltZSBzYWxhcnkgZm9yIHBhcnQgdGltZSB3b3JrZXJzDQpzYWxhcmllcyA8LSBzYWxhcmllcyAlPiUgDQogIG11dGF0ZShtdWx0aXBsaWVyID0gaWZfZWxzZSh3b3JrX2hvdXJzID09ICJQYXJ0IHRpbWUiLCAxLjUsIDEpLA0KICAgICAgICAgZnRfc2FsYXJ5ID0gZ3Jvc3Nfc2FsYXJ5ICogbXVsdGlwbGllcikgJT4lIA0KICBzZWxlY3QoLXdvcmtfaG91cnMsIC1tdWx0aXBsaWVyLCAtZ3Jvc3Nfc2FsYXJ5KQ0KDQojIEZpbHRlciBhbmQgdW5pZnkgcm9sZXMgDQpzYWxhcmllcyA8LSBzYWxhcmllcyAlPiUgDQogIGZpbHRlcihyb2xlICE9ICJKdXpnYWRvIENpdmlsIHkgQ29tZXJjaWFsIiwNCiAgICAgICAgIHJvbGUgIT0gIlByb2dyYW1hZG9yIiwNCiAgICAgICAgIHJvbGUgIT0gIkN1aWRhZG8iLA0KICAgICAgICAgcm9sZSAhPSAiQXNlc29yIiwNCiAgICAgICAgIHJvbGUgIT0gIkplZmUgZGUgUHJveWVjdG8iKSAlPiUgDQogIG11dGF0ZShyb2xlID0gc3RyX3RyaW0ocm9sZSwgc2lkZSA9ICJib3RoIiksICMgRWxpbWluYSBlc3BhY2lvcyB2YWPDrW9zDQogICAgICAgICByb2xlID0gZmN0X2NvbGxhcHNlKHJvbGUsICJHZXJlbnRlIiA9ICJTdXBlcmludGVuZGVudGUiKSwNCiAgICAgICAgIHJvbGUgPSBmY3RfY29sbGFwc2Uocm9sZSwgIkRpcmVjdG9yIiA9ICJEaXJlY3RvciAoIGVzY2FsYWbDs24gbXVuaWNpcGFsKSIpLA0KICAgICAgICAgcm9sZSA9IGZjdF9jb2xsYXBzZShyb2xlLCAiSFJCUCIgPSBjKCJTZW5pb3IgQ29uc3VsdG9yw61hIiwgInNwZWNpYWxpc3QiLCAiZXNwZWNpYWxpc3RhIiwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIkVzcGVjaWFsaXN0YSBlbiBzZWxlY2Npw7NuIElUIiwgIlJlY3J1aXRlciIpKSwNCiAgICAgICAgIHJvbGUgPSBmY3RfY29sbGFwc2Uocm9sZSwgIlJlc3BvbnNhYmxlIiA9IGMoIkNvb3JkaW5hY2nDs24iLCAiQ29vcmRpbmFkb3IgZGUgUGF5cm9sbCIsDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiRW5jYXJnYWRvIiwgIlN1cGVydmlzb3IiKSksDQogICAgICAgICByb2xlID0gZmN0X2NvbGxhcHNlKHJvbGUsICJBZG1pbmlzdHJhdGl2byIgPSBjKCJBc2lzdGVudGUiLCAiQXNpc3RlbnRlIFJSSEgiLCAiQXV4IiwgDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiQ2FwYWNpdGFkb3IiLCAiQ29uc3VsdG9yIEVqZWN1dGl2byIsDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiY29uc3VsdG9yIGpyIikpLA0KICAgICAgICAgcm9sZSA9IGZjdF9jb2xsYXBzZShyb2xlLCAiQW5hbGlzdGEiID0gYygiQXNlc29yYW1pZW50byIsICJDb25zdWx0b3IiLCAiR2VuZXJhbGlzdGEiLCANCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJSZWNsdXRhZG9yYSIsICJTZWxlY3RvcmEiLCAiU2VuaW9yIikpKSANCg0KIyBGaWx0ZXIgcm9sZXMgdG8gYW5hbHl6ZQ0Kc2FsYXJpZXMgPC0gc2FsYXJpZXMgJT4lIA0KICBmaWx0ZXIocm9sZSAlaW4lIGMoIkFuYWxpc3RhIiwgIkhSQlAiLCAiUmVzcG9uc2FibGUiLA0KICAgICAgICAgICAgICAgICAgICAgIkplZmUiLCAiR2VyZW50ZSIpKQ0KDQojIFdyaXRlIGEgY3N2IGZpbGUgdG8gc2hhcmUNCndyaXRlX2RlbGltKHNhbGFyaWVzLCBmaWxlID0gImhyX3NhbGFyaWVzX2FyZy5jc3YiLA0KICAgICAgICAgICAgZGVsaW0gPSAiOyIpDQpgYGANCg0KSSB0eXBpY2FsbHkgbGlrZSB0byBjdXN0b21pemUgbXkgY2hhcnRzLCBzbyBJIHVzdWFsbHkgZG8gdGhpcyBtb2RpZmljYXRpb25zLg0KDQpgYGB7ciBjaGFydF9zZXR0aW5nc30NCm9wdGlvbnMoc2NpcGVuID0gOTk5KSAgICMgTW9kaWZpZXMgdGhlIHNjaWVudGlmaWMgbm90YXRpb25zIG9mIHBsb3RzIHRvIG5vbWluYWwgdmFsdWVzDQoNCmV4dHJhZm9udDo6bG9hZGZvbnRzKHF1aWV0ID0gVFJVRSkgIyBMb2FkcyBkaWZmZXJlbnQgZm9udHMgaW50byBSDQoNCiMgQ2xlYW4gc3R5bGUgd2l0aCBncmV5IGhvcml6b250YWwgbGluZXMNCnN0eWxlaCA8LSB0aGVtZShwYW5lbC5ncmlkID0gZWxlbWVudF9ibGFuaygpLA0KICAgICAgICAgICAgICAgICBwbG90LmJhY2tncm91bmQgPSBlbGVtZW50X3JlY3QoZmlsbCA9ICIjRkJGQ0ZDIiksDQogICAgICAgICAgICAgICAgIHBhbmVsLmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCksDQogICAgICAgICAgICAgICAgIHBhbmVsLmdyaWQubWFqb3IueSA9IGVsZW1lbnRfbGluZShjb2xvciA9ICIjQUVCNkJGIiksDQogICAgICAgICAgICAgICAgIHRleHQgPSBlbGVtZW50X3RleHQoZmFtaWx5ID0gIlJvYm90byIpLA0KICAgICAgICAgICAgICAgIHBsb3QudGl0bGUucG9zaXRpb24gPSAicGxvdCIpDQoNCnN0eWxldiA8LSB0aGVtZShwYW5lbC5ncmlkID0gZWxlbWVudF9ibGFuaygpLA0KICAgICAgICAgICAgICAgICBwbG90LmJhY2tncm91bmQgPSBlbGVtZW50X3JlY3QoZmlsbCA9ICIjRkJGQ0ZDIiksDQogICAgICAgICAgICAgICAgIHBhbmVsLmJhY2tncm91bmQgPSBlbGVtZW50X2JsYW5rKCksDQogICAgICAgICAgICAgICAgIHBhbmVsLmdyaWQubWFqb3IueCA9IGVsZW1lbnRfbGluZShjb2xvciA9ICIjQUVCNkJGIiksDQogICAgICAgICAgICAgICAgIHRleHQgPSBlbGVtZW50X3RleHQoZmFtaWx5ID0gIlJvYm90byIpLA0KICAgICAgICAgICAgICAgICBwbG90LnRpdGxlLnBvc2l0aW9uID0gInBsb3QiKQ0KDQoNCiMgTW9kaWZ5IHRoZSB3YXkgdGhlIHkgYXhpcyBpcyBkaXNwbGF5ZWQNCmF4aXNfeF9uIDwtIHNjYWxlX3hfY29udGludW91cyhsYWJlbHMgPSBjb21tYV9mb3JtYXQoYmlnLm1hcmsgPSAiLiIsIGRlY2ltYWwubWFyayA9ICIsIikpDQpheGlzX3lfbiA8LSBzY2FsZV95X2NvbnRpbnVvdXMobGFiZWxzID0gY29tbWFfZm9ybWF0KGJpZy5tYXJrID0gIi4iLCBkZWNpbWFsLm1hcmsgPSAiLCIpKQ0KDQoNCiMgQ29sb3JzDQpnZW5kZXJfY29sb3JzIDwtIGdlbmVybyA8LSBjKCIjODYyNEY1IiwgIiMxRkMzQUEiKSAjIFB1cnBsZSBhbmQgZ3JlZW4gKHNvcnQgb2YgOnApDQoNCiMgRGF0YSBzb3VyY2UgZm9yIHBsb3QncyBjYXB0aW9uDQpmdWVudGUgPC0gIkRhdGEgU291cmNlOiBFbmN1ZXN0YSBLSVdJIGRlIFN1ZWxkb3MgZGUgUlJISCBMQVRBTSAyMDIwXG5SNEhSIENsdWIgZGUgUiBwYXJhIFJSSEgiDQpgYGANCg0KVGhlIGRhdGEgd2FzIGNvbGxlY3RlZCBpbiBTcGFuaXNoLCBzbyBsZXQncyB0cmFuc2xhdGUgdGhlIHZhbHVlcyBpbnRvIEVuZ2xpc2ggZmlyc3QgYW5kIHN1bW1hcmlzZSB0aGUgaW5mb3JtYXRpb246DQoNCmBgYHtyIHRyYW5zbGF0ZX0NCiMgVHJhbnNsYXRlIHZhbHVlcw0Kc2FsYXJpZXMgPC0gc2FsYXJpZXMgJT4lIA0KICBtdXRhdGUoZ2VuZGVyID0gZmN0X3JlY29kZShnZW5kZXIsICJGZW1hbGUiID0gIkZlbWVuaW5vIiwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIk1hbGUiID0gIk1hc2N1bGlubyIpLA0KICAgICAgICAgcm9sZSA9IGZjdF9yZWNvZGUocm9sZSwgIkFuYWx5c3QiID0gIkFuYWxpc3RhIiwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICJTdXBlcnZpc29yIiA9ICJSZXNwb25zYWJsZSIsDQogICAgICAgICAgICAgICAgICAgICAgICAgICAiSGVhZCIgPSAiSmVmZSIsDQogICAgICAgICAgICAgICAgICAgICAgICAgICAiTWFuYWdlciIgPSAiR2VyZW50ZSIpLA0KICAgICAgICAgcm9sZSA9IGZjdF9yZWxldmVsKHJvbGUsIGMoIkFuYWx5c3QiLCAiSFJCUCIsICJTdXBlcnZpc29yIiwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIkhlYWQiLCAiTWFuYWdlciIpKSkgDQoNCiMgTGV0J3MgbWFrZSBhIHN1bW1hcnkgYW5hbHlzaXMgb2YgdGhlIGRhdGENCnN1bW1hcnkoc2FsYXJpZXMpDQpgYGANCg0KVGhlcmUgYXJlIGEgY291cGxlIG9mIHVudXN1YWwgdmFsdWVzLiBGaXJzdCB0aGUgbWluaW11bSB2YWx1ZSwgdGhhdCdzIGNsZWFybHkgYSBtaXN0YWtlIChvciBhIGJhZCBpbnRlbmRlZCBwZXJzb24pLCBhbmQgdGhlIG1heGltdW0gdmFsdWUsIHRoYXQgY291bGQgcG9zc2libGUsIGJ1dCBoaWdobHkgdW51c3VhbCBmb3IgdGhlIEFyZ2VudGluZWFuIG1hcmtldC4gSWYgd2UgbWFrZSBhIGhpc3RvZ3JhbSwgdGhlIHJlc3VsdCB3b3VsZCBiZSBhd2t3YXJkLg0KDQpgYGB7ciBoaXN0LTF9DQpnZ3Bsb3Qoc2FsYXJpZXMsIGFlcyh4ID0gZnRfc2FsYXJ5KSkgKw0KICBnZW9tX2hpc3RvZ3JhbSgpICsNCiAgbGFicyh0aXRsZSA9ICJHcm9zcyBTYWxhcnkgRGlzdHJpYnV0aW9uIGluIEhSIiwNCiAgICAgICBzdWJ0aXRsZSA9ICJEYXRhIGZyb20gQXJnZW50aW5hIHwgSW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwgeSA9IE5VTEwsDQogICAgICAgY2FwdGlvbiA9IGZ1ZW50ZSkgKw0KICBheGlzX3hfbiArDQogIHN0eWxlaA0KYGBgDQoNClRoaXMgaXMgd2hlcmUgYGZ1bk1vZGVsaW5nYCBjb21lcyBoYW5keS4gVGhlIGBwcm9maWxpbmdfbnVtYCBmdW5jdGlvbiBkZWxpdmVycyBhIHRhYmxlIHdpdGggYSBsb3Qgb2YgZGVzY3JpcHRpdmUgc3RhdGlzdGljcyBmb3IgbnVtZXJpY2FsIHZhcmlhYmxlcy4NCg0KYGBge3IgY2xlYW5pbmdfbnVtfQ0KKG51bWVyaWNhbCA8LSBwcm9maWxpbmdfbnVtKHNhbGFyaWVzKSkNCmBgYA0KDQpTaW5jZSBJIHdhbnQgdG8gYW5hbHl6ZSBjZW50cmFsIHZhbHVlcyBvZiB0aGUgc2FsYXJpZXMsIEknbGwgZmlsdGVyIGV2ZXJ5dGhpbmcgYmV5b25kIHRoZSBwZXJjZW50aWxlcyA1IGFuZCA5NS4NCg0KYGBge3IgY2xlYW5pbmdfbnVtMn0NCiMgU3RvcmUgcGVyY2VudGlsZXMgNSBhbmQgOTUgdG8gZmlsdGVyDQpwMDUgPC0gbnVtZXJpY2FsWzEsNl0NCnA5NSA8LSBudW1lcmljYWxbMSwxMF0NCg0KIyBGaWx0ZXIgdmFsdWVzIHdpdGhpbiB0aGUgcDA1IGEgcDk1IHZhbHVlcw0Kc2FsYXJpZXMgPC0gc2FsYXJpZXMgJT4lIA0KICBmaWx0ZXIoYmV0d2VlbiggICAgIyBTdXBwb3J0aW5nIGZ1bmN0aW9uDQogICAgZnRfc2FsYXJ5LCAgICAjIFZhcmlhYmxlIHRvIGZpbHRlcg0KICAgIHAwNSwgICAgICAgICAgICAgIyBNaW5pbXVtIHRocmVzaG9sZA0KICAgIHA5NSAgICAgICAgICAgICAgIyBNYXhpbXVuIHRocmVzaG9sZA0KICApKQ0KDQojIE5vdyBJIGNhbiByZW1vdmUgdGhlIG9iamVjdHMgSSB3b3VsZCBubyBsb25nZXIgdXNlDQpybShudW1lcmljYWwsIHAwNSwgcDk1KQ0KYGBgDQoNCk5vdyB0aGF0IHdlIGhhdmUgYSBjbGVhbmVyIHZlcnNpb24gb2YgdGhlIGRhdGEgd2UgY2FuIHN0YXJ0IGNvbXBhcmluZyB0aGUgdmlzdWFsaXphdGlvbnM6DQoNCmBgYHtyIGhpc3QtMn0NCmdncGxvdChzYWxhcmllcywgYWVzKHggPSBmdF9zYWxhcnkpKSArDQogIGdlb21faGlzdG9ncmFtKCkgKw0KICBsYWJzKHRpdGxlID0gIkdyb3NzIFNhbGFyeSBEaXN0cmlidXRpb24gaW4gSFIgfCBDbGVhbiBEYXRhIiwNCiAgICAgICBzdWJ0aXRsZSA9ICJEYXRhIGZyb20gQXJnZW50aW5hIHwgSW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwgeSA9IE5VTEwsDQogICAgICAgY2FwdGlvbiA9IGZ1ZW50ZSkgKw0KICBheGlzX3hfbiArDQogIHN0eWxlaA0KYGBgDQoNCiMgQ29tcGFyaW5nIHZpc3VhbGl6YXRpb25zDQoNCiFbQ3JlZGl0czogQWxsaXNvbiBIb3JzdCBcQGFsbGlzb25faG9yc3RdKGh0dHBzOi8vcGJzLnR3aW1nLmNvbS9tZWRpYS9FS0hkazRJVThBQVFfWEIuanBnKXt3aWR0aD0iMzk5In0NCg0KV2h5IHdvdWxkIEkgdXNlIGEgYm94cGxvdCBpbnN0ZWFkIG9mIGEgc2ltcGxlIGJhciBwbG90PyBMZXQncyBnaXZlIGEgdHJ5IHVzaW5nIGEgYmFyIGNoYXJ0IHRvIGNvbXBhcmUgdGhlIG1lZGlhbiBzYWxhcnkgZm9yIGJvdGggbWVuIGFuZCB3b21lbiBpbiBlYWNoIHJvbGU6DQoNCmBgYHtyIGJhcnBsb3R9DQpzYWxhcmllcyAlPiUgDQogIGdyb3VwX2J5KHJvbGUsIGdlbmRlcikgJT4lIA0KICBzdW1tYXJpc2UobWVkaWFuX3NhbGFyeSA9IG1lZGlhbihmdF9zYWxhcnkpKSAlPiUgDQogIGdncGxvdChhZXMoeCA9IHJvbGUsIHkgPSBtZWRpYW5fc2FsYXJ5LCBmaWxsID0gZ2VuZGVyKSkgKw0KICBnZW9tX2NvbChwb3NpdGlvbiA9ICJkb2RnZSIpICsNCiAgc2NhbGVfZmlsbF9tYW51YWwodmFsdWVzID0gZ2VuZGVyX2NvbG9ycykgKw0KICBheGlzX3lfbiArDQogIHN0eWxlaCArDQogIGxhYnModGl0bGUgPSAiTWVkaWFuIFNhbGFyeSBwZXIgUm9sZSBhbmQgR2VuZGVyIGluIEhSIiwNCiAgICAgICBzdWJ0aXRsZSA9ICJEYXRhIGZyb20gQXJnZW50aW5hIHwgSW4gQVIkIiwNCiAgICAgICB5ID0gIk1lZGlhbiBTYWxhcnkgaW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwNCiAgICAgICBmaWxsID0gIkdlbmRlciIsDQogICAgICAgY2FwdGlvbiA9IGZ1ZW50ZSkNCmBgYA0KDQpTbyBpZiB3ZSBsb29rIGF0IGVhY2ggYmFyIHdlIGNhbiBzZWUgdGhhdCB0aGUgcGF5IGdhcCBmb3IgKkFuYWx5c3QqIGFuZCAqU3VwZXJ2aXNvciogaXMgbGFyZ2VyIHRoYW4gaW4gdGhlIG90aGVyIHJvbGVzLCBzbyBtYWxlIEhSIHBlb3BsZSBlYXJucyBtb3JlIHRoYW4gdGhlaXIgZmVtYWxlIGNvbGxlYWd1ZXMuIEJ1dCB3aGVuIHdlIGxvb2sgaW50byAqSFJCUHMqIGFuZCAqTWFuYWdlcnMqLCB0aGUgbWVkaWFuIHNhbGFyeSBmb3Igd29tZW4gaXMgc2xpZ2h0bHkgaGlnaGVyIHRoYW4gbWVuLCBhbmQgZXZlbiBpbiB0aGUgKkhlYWQqIHJvbGUsIHRoZSBnYXAgaXMgcXVpdGUgY2xvc2UuIFNvIHdpdGggdGhpcyBldmlkZW5jZSB3ZSBjb3VsZCBzYXkgdGhhdCB0aGUgZ2VuZGVyIHNhbGFyeSBnYXAgaW4gSHVtYW4gUmVzb3VyY2VzIGluIEFyZ2VudGluYSBpdCdzIG5vdCBhIGlzc3VlLCBidXQuLi4NCg0KIVtdKGh0dHBzOi8vbWVkaWEuZ2lwaHkuY29tL21lZGlhLzlBSW8xYUpqdFZURGQ3RDN3Yy9naXBoeS5naWYpe3dpZHRoPSI0MDgifQ0KDQojIyBCb3hwbG90cw0KDQpJbiB0aGUgZGlzY3Vzc2lvbiBpbiBMaW5rZWRJbiwgTmljayBEZXNiYXJhdHMgc2FpZCB0aGF0IGhlIHN0cnVnZ2xlcyB0byBjb21lIHVwIHdpdGggdXNlIGNhc2VzIGluIHdoaWNoIGJveHBsb3RzIHdvdWxkIGJlIHRoZSBiZXN0IGNob2ljZSwgc28gSSBzaGFyZWQgdGhpcyBwbG90Og0KDQpgYGB7ciBib3hwbG90fQ0KZ2dwbG90KHNhbGFyaWVzLCBhZXMoeCA9IHJvbGUsIHkgPSBmdF9zYWxhcnksIGZpbGwgPSBnZW5kZXIpKSArDQogIGdlb21fYm94cGxvdCgpICsNCiAgc2NhbGVfZmlsbF9tYW51YWwodmFsdWVzID0gZ2VuZGVyX2NvbG9ycykgKw0KICBheGlzX3lfbiArDQogIHN0eWxlaCArDQogIGxhYnModGl0bGUgPSAiU2FsYXJ5IERpc3RyaWJ1dGlvbiBpbiBIUiBSb2xlcyBpbiBBcmdlbnRpbmEiLA0KICAgICAgIHN1YnRpdGxlID0gIkluIEFSJCIsDQogICAgICAgeSA9ICJHcm9zcyBTYWxhcnkgaW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwNCiAgICAgICBmaWxsID0gIkdlbmRlciIsDQogICAgICAgY2FwdGlvbiA9IGZ1ZW50ZSkNCmBgYA0KDQpXaGF0IEkgbGlrZSBhYm91dCB0aGlzIHZpc3VhbGl6YXRpb24gaXMgdGhhdCB3ZSBjYW4gc2VlIHRoZSBkaXN0cmlidXRpb24gb2YgdGhlIHNhbGFyaWVzIGJ5IHRoZSBzaXplIG9mIHRoZSBoYWx2ZXMgb2YgdGhlIGJveGVzLiBMZXMgdGFrZSBmb3IgaW5zdGFuY2UgdGhlICpIZWFkKiBwb3NpdGlvbi4gVGhlIG1lZGlhbnMgYXJlIHNpbWlsYXIsIGJ1dCBpbiB0aGUgY2FzZSBvZiB3b21lbiB0aGUgYm90dG9tIGhhbGYgb2YgdGhlIGJveCBpcyBsYXJnZXIsIHNvIHRoYXQgbWVhbnMgdGhhdCB0aGUgcmFuZ2Ugb2Ygc2FsYXJpZXMgZm9yIHdvbWVuIGlzIGJyb2FkZXIuIFRoYXQgdGVsbHMgdXMgdGhhdCB0aGVyZSBhcmUgd29tZW4gaW4gKkhlYWQqIHBvc2l0aW9uIHdpdGggc2FsYXJpZXMgZmFyIGJlbG93IHRoZSBtZWRpYW4uDQoNClRoZSBvcHBvc2l0ZSBoYXBwZW5zIHdpdGggbWFsZSBwcm9mZXNzaW9uYWxzIGluIHRoZSAqSGVhZCogcG9zaXRpb24uIFRoZSB0b3AgaGFsZiBvZiB0aGUgYm94IGlzIGxhcmdlciBtZWFuaW5nIHRoYXQgdGhlcmUgYXJlIG1lbiBpbiB0aGUgKkhlYWQqIHBvc2l0aW9uIHdpdGggc2FsYXJpZXMgZmFyIGFib3ZlIHRoZSBtZWRpYW4uDQoNCkJ1dCBOaWNrIGhhcyBhIHBvaW50LiBIb3cgbWFueSBkYXRhIHBvaW50cyB3ZSBoYXZlPyAzLCAxNSwgMzAwPyBXZSBjYW4ndCB0ZWxsIGZyb20gdGhpcyBwbG90LiBTbyBoZSBzdWdnZXN0ZWQgdG8gdHJ5IGEgKip2aW9saW4gY2hhcnQqKi4gU28gbGV0J3Mgc2VlIHdoYXQgZ29lcyBvbjoNCg0KIyMgVmlvbGluIGNoYXJ0DQoNCmBgYHtyIHZpb2xpbn0NCmdncGxvdChzYWxhcmllcywgYWVzKHggPSByb2xlLCB5ID0gZnRfc2FsYXJ5LCBmaWxsID0gZ2VuZGVyKSkgKw0KICBnZW9tX3Zpb2xpbigpICsNCiAgc2NhbGVfZmlsbF9tYW51YWwodmFsdWVzID0gZ2VuZGVyX2NvbG9ycykgKw0KICBheGlzX3lfbiArDQogIHN0eWxlaCArDQogIGxhYnModGl0bGUgPSAiU2FsYXJ5IERpc3RyaWJ1dGlvbiBpbiBIUiBSb2xlcyBpbiBBcmdlbnRpbmEiLA0KICAgICAgIHN1YnRpdGxlID0gIkluIEFSJCIsDQogICAgICAgeSA9ICJHcm9zcyBTYWxhcnkgaW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwNCiAgICAgICBmaWxsID0gIkdlbmRlciIsDQogICAgICAgY2FwdGlvbiA9IGZ1ZW50ZSkNCmBgYA0KDQpHaXZlbiB0aGUgYW1vdW50IG9mIHJvbGVzIHdlIGNhbid0IGFwcHJlY2lhdGUgdGhlIHZhbHVlIG9mIHRoaXMga2luZCBvZiBjaGFydC4gU28gbGV0J3MgcmVwZWF0IGl0IG9ubHkgd2l0aCAqQW5hbHlzdHMqIGFuZCAqTWFuYWdlcnMuKg0KDQpgYGB7ciB2aW9saW4yfQ0Kc2FsYXJpZXMgJT4lIA0KICBmaWx0ZXIocm9sZSAlaW4lIGMoIkFuYWx5c3QiLCAiTWFuYWdlciIpKSAlPiUgDQogIGdncGxvdChhZXMoeCA9IHJvbGUsIHkgPSBmdF9zYWxhcnksIGZpbGwgPSBnZW5kZXIpKSArDQogIGdlb21fdmlvbGluKCkgKw0KICBzY2FsZV9maWxsX21hbnVhbCh2YWx1ZXMgPSBnZW5kZXJfY29sb3JzKSArDQogIGF4aXNfeV9uICsNCiAgc3R5bGVoICsNCiAgbGFicyh0aXRsZSA9ICJTYWxhcnkgRGlzdHJpYnV0aW9uIGluIEhSIFJvbGVzIGluIEFyZ2VudGluYSIsDQogICAgICAgc3VidGl0bGUgPSAiSW4gQVIkIiwNCiAgICAgICB5ID0gIkdyb3NzIFNhbGFyeSBpbiBBUiQiLA0KICAgICAgIHggPSBOVUxMLA0KICAgICAgIGZpbGwgPSAiR2VuZGVyIiwNCiAgICAgICBjYXB0aW9uID0gZnVlbnRlKQ0KDQpgYGANCg0KVGhlIHdpZHRoIG9mIGVhY2ggcGxvdCBpbmRpY2F0ZXMgdGhhdCB0aGUgcmVnaW9uIGlzIHBvcHVsYXRlZCB3aXRoIG1vcmUgY2FzZXMuIFNvLCBmb3IgbWFsZSBtYW5hZ2VycyB3ZSBjYW4gc2VlIHRoYXQgbW9zdCBvZiB0aGVtIGFyZSBjbG9zZSB0byB0aGUgbWVkaWFuLiBUaGUgbGVuZ2h0IG9mIHRoZSBwbG90cyBpbmRpY2F0ZXMgdGhlIHJhbmdlIG9mIHRoZSB2YWx1ZXMuIFNvLCBpbiB0aGUgY2FzZSBvZiBmZW1hbGUgbWFuYWdlcnMgdGhlIHJhbmdlIGdvZXMgZnJvbSBhcm91bmQgQVJcJCA1MC4wMDAgdXAgdG8gY2xvc2UgdG8gQVJcJCAyMDAuMDAwIGFuZCB0aGUgd2lkdGggaXMgcXVpdGUgZXZlbiBhbGwgYWxvbmcgdGhlIGRhdGEgcG9pbnRzLg0KDQpJbiB0aGUgY2FzZSBvZiB0aGUgQW5hbHlzdHMsIGZvciB3b21lbiB3ZSBjYW4gc2VlIHRoYXQgdGhlcmUgYXJlIHdpZGVyIHNlY3Rpb24gYXJvdW5kIEFSXCQgNTAuMDAwIGFuZCB0aGUgc3RhcnQgdG8gbmFycm93IHRvIHRoZSB0b3AuIEluIHRoZSBjYXNlIG9mIG1lbiB0aGUgd2lkZXN0IHBhcnQgaXMgYWJvdmUgdGhhbiB3b21lbiwgYW5kIHRoZSByYW5nZSBleHBhbmRzIHRvIGdyZWF0ZXIgdmFsdWVzLg0KDQpQZXJoYXBzIGZvciB0aGlzIGRhdGFzZXQsIHRoZSB2aW9saW4gY2hhcnQgaXMgbm90IHRoZSBtb3N0IHN1aXRhYmxlIGNhc2UuIExldCdzIHRyeSBhICoqc2NhdHRlciBwbG90KiouDQoNCiMjIFNjYXR0ZXIgcGxvdA0KDQpBbm90aGVyIHdheSB3ZSBjYW4gc2VlIHRoZSBkaXN0cmlidXRpb24gb2YgdGhlIGRhdGEgcG9pbnRzIGlzIHRoZSBzY2F0dGVyIHBsb3QuIFdlIHRlbmQgdG8gc2VlIHRoZW0gZm9yIHJlbGF0aW9uc2hpcHMgYmV0d2VlbiB0d28gbnVtZXJpY2FsIHZhcmlhYmxlcywgYnV0IHdlIGNhbiB1c2UgaXQgd2l0aCBub21pbmFsIHZhcmlhYmxlcyBhcyB3ZWxsLg0KDQpgYGB7ciBzY2F0dGVyX3Bsb3R9DQpnZ3Bsb3Qoc2FsYXJpZXMsIGFlcyh4ID0gcm9sZSwgeSA9IGZ0X3NhbGFyeSwgY29sb3IgPSBnZW5kZXIpKSArDQogIGdlb21fcG9pbnQoc2l6ZSA9IDMsDQogICAgICAgICAgICAgYWxwaGEgPSAwLjIsDQogICAgICAgICAgICAgcG9zaXRpb24gPSBwb3NpdGlvbl9qaXR0ZXIoMC4zKSkgKw0KICBzY2FsZV9jb2xvcl9tYW51YWwodmFsdWVzID0gZ2VuZGVyX2NvbG9ycykgKw0KICBzdHlsZWggKw0KICBheGlzX3lfbiArDQogIGxhYnModGl0bGUgPSAiU2FsYXJ5IERpc3RyaWJ1dGlvbiBwZXIgR2VuZGVyIGFuZCBSb2xlIGluIEhSIiwNCiAgICAgICBzdWJ0aXRsZSA9ICJIUiBQcm9mZXNzaW9uYWxzIGluIEFyZ2VudGluYSB8IEluIEFSJCIsDQogICAgICAgeSA9ICJHcm9zcyBTYWxhcnkgaW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwNCiAgICAgICBjb2xvciA9ICJHZW5kZXIiLA0KICAgICAgIGNhcHRpb24gPSBmdWVudGUpDQpgYGANCg0KQWdhaW4sIGZvciB0aGlzIGRhdGFzZXQsIHRoZSBzY2F0dGVyIHBsb3QgY2FuIGJlIG1vcmUgY29uZnVzaW5nIGJlY2F1c2UgaW4gc29tZSBwb3NpdGlvbnMsIGxpa2UgKkFuYWx5c3RzKiBhbmQgKlN1cGVydmlzb3IqIGFyZSBzbyBwb3B1bGF0ZWQgYW5kIGl0J3MgaGFyZCB0byB0ZWxsIHRoZSBkaWZmZXJlbmNlcyBieSBjb2xvci4gQnV0IGZvciBpbnN0YW5jZSwgZm9yICpNYW5hZ2Vycyogd2UgY2FuIGFwcHJlY2lhdGUgdGhlIHJhbmdlIG9mIHRoZSBzYWxhcmllcywgYW5kIGFsc28gdGhlIGNvbmNlbnRyYXRpb24gZm9yIG1lbi4NCg0KUGVyaGFwcyB3ZSBjb3VsZCBzcGxpdCB0aGUgY2hhcnRzIGluIHNtYWxsZXIgY2hhcnRzLCB0byBzZWUgaWYgaXQgaGVscHMgdG8gY2xhcmlmeSB0aGUgZGF0YSBhbmQgaXRzIGludGVycHJldGF0aW9uLg0KDQpgYGB7ciBzY2F0dGVyX3Bsb3QyLCBmaWcuaGVpZ2h0PTh9DQpnZ3Bsb3Qoc2FsYXJpZXMsIGFlcyh4ID0gZ2VuZGVyLCB5ID0gZnRfc2FsYXJ5LCBjb2xvciA9IGdlbmRlcikpICsNCiAgZ2VvbV9wb2ludChzaXplID0gMywNCiAgICAgICAgICAgICBhbHBoYSA9IDAuMiwNCiAgICAgICAgICAgICBwb3NpdGlvbiA9IHBvc2l0aW9uX2ppdHRlcigwLjIyKSkgKw0KICBzY2FsZV9jb2xvcl9tYW51YWwodmFsdWVzID0gZ2VuZGVyX2NvbG9ycykgKw0KICBzdHlsZWggKw0KICBheGlzX3lfbiArDQogIGxhYnModGl0bGUgPSAiU2FsYXJ5IERpc3RyaWJ1dGlvbiBwZXIgR2VuZGVyIGFuZCBSb2xlIGluIEhSIiwNCiAgICAgICBzdWJ0aXRsZSA9ICJIUiBQcm9mZXNzaW9uYWxzIGluIEFyZ2VudGluYSB8IEluIEFSJCIsDQogICAgICAgeSA9ICJHcm9zcyBTYWxhcnkgaW4gQVIkIiwNCiAgICAgICB4ID0gTlVMTCwNCiAgICAgICBjb2xvciA9ICJHZW5kZXIiLA0KICAgICAgIGNhcHRpb24gPSBmdWVudGUpICsNCiAgZmFjZXRfd3JhcCh+cm9sZSwgbnJvdyA9IDEpDQpgYGANCg0KTm93IHdlIGNhbiBhcHByZWNpYXRlIGluIGEgYmV0dGVyIHdheSBhbGwgdGhlIHBvc2l0aW9ucyBvZiB0aGUgZGF0YSBwb2ludHMsIHdoZXJlIGRhdGEgaXMgbW9yZSBjb25jZW50cmF0ZWQgYW5kIGFsc28gdGhlIGRpZmZlcmVudCByYW5nZXMgb2YgdGhlIHNhbGFyaWVzIGZvciBib3RoIG1lbiBhbmQgd29tZW4gaW4gdGhlIGRpZmZlcmVudCByb2xlcy4gSXQncyBlYXNpZXIgdG8gY29tcGFyZSB0aGUNCg0KIyBDb25jbHVzaW9ucw0KDQpJJ3ZlIHN0YXJ0ZWQgdGhpcyBleGVyY2lzZSBiaWFzZWQgYnkgb3duIGV4cGVyaWVuY2UgdXNpbmcgZGlmZmVyZW50IGtpbmRzIG9mIGNoYXJ0cy4NCg==